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ABSTRACT 

Criticism and evaluation of classroom speeches in 
communication courses should be centered more on student oriented 
methods rather than on instructor evaluation alone. One approach is 
based on the use of seven-point differential scales ^ whereby students 
can provide immediate reactions to performances by their classmates. 
This method is of value to students both as speakers and as critics; 
it also assesses the behavioral outcomes of utilizing the principles 
taught in basic communication courses. A second procedure applies 
specifically to the informative speech^ whereby each speaker obtains^ 
in short ^^ritten form^ statements from his audience that tell him if 
the audience recognized and retained the important points of 
information from hi^i presentation. Finallyr in evaluating persuasive 
speeches^ student-critics can be asked to list their personal 
reactions to each proposition in the speeches^ as well as their 
predictions of both the average audience response and the response 
distribution (scattered or clustered) . This third approach is 
basically an exercise in audience analysis. (RN) 
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Responding to the question at the University of 
Hawaii of "How do we move away from a teacher 
dominated classrt'om especially jn the area of speech 
criticism and evaluation?," the three approaches de- 
scribed here were considered as ones with which a 
teacher niight like to begin in finding those methods 
most 5uita!->!c for the situation in whicli lie finds 
himself. 

I. 

ApinjcATioN OF Spi-;i:cn Ratings 

Any speech situation, no matter how narrowly spe- 
cified, is a con'iplex situation. Any effort directed 
toward improvini^ ihc speech beliavior of th? .speaker 
by a critic, no matter how slu'llful, is as difficult as 
the situation is conaplex. Fortunately, our tradition 
has a healthy array of function a J speech vAting forms 
available to sjxakc-r and critic alike. To introduce 
another altern.itive form demands an appeal which 
is broader than. "Here is one you ir\\ghl try if you 
art unhappy with yonr current choice." The approach 
to speech ratint^s considered here encompasses two 
distinct app^jals, and while it is not original in its 
funtlamentai reliance on semantic differential scales, 
it has evoKcd over a number of years througl'; test 
and application in the speech cku-sroom. 

Briefly, tlie approach assinnes a utility for word- 
phrase bound seven -point scales that can be clustered 
under selected concepts. Such a rating form might 
place under the concept "content" the scale: 

Made Credible Credibility Assumed 

by Speaker — :- : — : — : — : — by Speaker 

Our conc^^-rn centers no: on the research potential of 
the scalin^t; mcchodology, but rather on developing 
useful, dcscripti\e scales which accommodate ac- 
knowledgCLl speech concepts, and even on the evolv- 
ing of important concepts from the growth of related 
scalus. VC^'hen we realize the number of rounds of 
speeches a teacher he.irs each year, and the ease of 
use arjd avaikihih'ty of duph'cating m.ichines. each 
teacher wuli the use of a Sf.-.all card tile and a luim- 
bcr oi ditto masters can quickly determine for his 
own needs tiiose concept- scale cotnbi nations that arc 
appropriate for him. Studedts quicklv feedbaLk their 
reaction to scales dia: are "fuzzy" or "ambiguous" 
and to scales that clearly c^cW out the limits of the 



teacher's immediate interest. 7'hc teacher, too, quickly 
learns, by trying out constructed scales, tliat some are 
useful and some need discarding. 

The first appeal of this approach to speech rating 
is that of utility to speaker and critic alike. Current 
rating forms can be placed on a continuum bounded 
b)' the concept "extremely useful to the speaker" and 
the concept "extremely useful to the critic." They 
are useful if and when they clearly specit) j^roblcms 
and suggest guidelines for improvement. l*roin the 
critic's point of view, they are useful if and when 
they oi'fcr a broad array of alternatives to wliicli at- 
tention can be called by a simple check i/ia rk as well 
.IS a number of catergories that coincide with the 
critic's image of the significant speech variables. The 
present approach to rating was de\eloped to integrate 
the two extremes of that, continuum — 'extremely 
useful to the speaker" — "extremely useful to the 
critic." Impro\ement, stagnation, or regression can 
be clearly noted by the critic across a series of speech 
assignments for each speaker. A simple check mark 
in one slot of each scale employed can be made 
quickly by tlie critic, and these marks arc- quite in- 
dependent of any marks gi\'en a speaker on a pre- 
vious assignment as t'ar as the memory of the critic is 
concerned. No teacher \^-ith, say. three sections of 
twenty students each is going to remember the last 
rating he gave a particular speaker on a particular 
scale. 

The concepts selected for the rating sheet and the 
scales chosen imder each concept reflect tlie critic'^ 
desired emphasis in any given round of speeciie.-;. 
From the student's point of view, the present tech- 
nique provide.'; a limited, dehncd index of success- 
failure and a quick reference to past and future ef-- 
forts. It does not select a concept such as "reasoning" 
and merely indicate with a check mark "needs im- 
provement," but' rather, indicates the instructor's re- 
sponse .long a specific continuum. For instAncc*, it 
miglit be h.clpfu! to use "clear analogy — obscure 
analogy." Should a student employ what the teacher- 
critic views as analogical reasoning, the check mark 
indicates a more specific reaction than either "needs 
improvement" or "s.itisfactory."' 

The second apjKMl of this mod.c of criticism and 
e\aluation is that it provides some behavioral indicie.s 
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of success- fr.i 1 11 re. 'Hic r.uing form considered here 
cont.iins scales to characterize the beh.nior.il outcome 
of praciicin,!; or iiinorint: certain principles espoused 
in many basic speech courses. The following cxMm- 
plcj ma\ he helpful in the construLtik'n of appropriate- 
scales for your course if you can state your termin.Tl 
objectives behavior.! lly. Under the concept structure, 
for examj.ile, "strong audience adaption — ^vc.^k au- 
dience ad.iption" char.icteri;;es the result of the elTort 
expended by the speaker on his introLluction, tran- 
sitions, anil conclusion as they relate to his present, 
real audience. A favorable check m.irk is not a golil 
star for producing something th.it can he rccoi:ni:^eLl 
as an "introduction," "transition. ' or "conclusion." 
It is a description of the "goodness" of these ele- 
ments in terms of how they "fit" widi this audience. 
Under the concept effects, "feedb.ick utilized-feedback 
not utilized" chnracterizes the extent to ^vh^ch the 
speaker modifies his overt sj:>eech behavior as a re- 
sponse to the audience's behavior. The scale conld 
be replaced or supplemented with "feedb.ick clicited- 
feedback 5iot eliciteil," and the descrij:^tive power of 
the appropriate check mark v.-oukl remain significant. 
Similarly, the scale term "maile crediible by speaker" 
does not index the mere inclusion of LloL'umentation 
and authorit)' but, rather. inLlicates the degree to 
which this inclusion i^roLluces in the critic the re- 
.sponse. "Me (the spe.iKer) is producing a believeable 
body of content." Nfnny scales were developed w ith 
this consideration in mind, ancl you might well find 
it enjovablc and profitable to construct more effective 
.scales to cluster under these or more functional 
concepts. 

1 

Assi-ssMUNT oi- Sphhchhs to IxroR>{ 

The assignment is often m.ide, "Prepare and de- 
liver a speech to inform." A problem of assessment 
immediately arises for speaker and listener alike. 
Typically, the classroom speaker who h.is been as- 
signed a "speech to inform" has one or n^ore of three 
objectives in mind-"nrst, that the audience will re- 
member that he did spc.ik and what the subject of 
his speech was; second. th.K the audience will be able 
to recogniiie certaiii items of information included iti 
his speech? third, that the audience will be able to 
remember the important points of his speech without 
prompt in^i. But in a classroom with twenty to thirty 
students, how can the asso.s*sment of the chosen ob- 
jective (s) be accomjilisheil easily, quickly, and with 
a minimum ot fuss? In .i busy classroom rhe svstem 
for evaluation and feedh.ick must be built into the 
learning situation and be accepted as a matter of 
course instead of becoming a special experiment. 

Working tow.nds this end with certain assiunptions 
in mind, the "Kommunication Kwiz" was designed. 



The .issum prions were that five to seven items from 
a short infWmati\e speech were as much ns a stu- 
dent could hope for his audience to recognize or re- 
call: th.u riie construction of the test items should be 
leit to tlie student spe.iker. thus guiding him to in- 
form with well-defined terminal object i\'es in mind; 
and. finally, rh.ii in t.iking the test the audience mem- 
bers would learn to recognize their responsibilities 
in the communicative situation for listening to gain 
information. 

The class procedure is as follows. Included in the 
:TssignmLnc of "a speech to inform" is the responsi- 
bility of ev.duation. E.ich speaker is required to con- 
struct n six -item test covering what he wants the class 
to recall or recognize from the information presented 
in his speech. The form of the test is left to the 
student. The audience members arc rec|uired to sup- 
ply themselves with three-by-fivc cards. On the as- 
signed day, the names of the speakers are written on 
the bonr^l in the order they will speak. The audience 
members write their n.imes in the upper left hand 
corner and the names of. the speakers in Hie lower 
right hand corner of their three-by-iive cards. At the 
conclusion of each speech the Sj:)eakers administer 
their evaluation quiz, either orally or written; the 
audience members .a-cord their aiiSwers on the ap- 
propriate card; and the speaker bollects the answers. 
These would bo graded outside of class. The scores 
also would be recor^led by the speaker on a master 
speaker form, and the cards, scorc^l nnd m. irked with 
the number correct as well us a notation of the class 
average, would be returned to the stuclents to be rc- 
coriled on their individual master listener forms. 

The di tier once between the two forms, of course, 
centers on which scores are recorded. The speaker 
records a score for each listener to b/s speech. The 
listener records his oirn score on each of the te.sts 
ij;iven by the various spenkers. The forms (m.ister 
spenker niul master listener) can be standardized or 
left to the discretion of the individual students. After 
every one has spoken, the listeners and speakers total 
their ind!\'idiKil scores. The entire process for all 
speakers consumes no more than five minutes of each 
class period. By looking down their individual master 
sheets the students as listeners can determine how 
well they have ' remembered or recalled the inform.i- 
tion a spe.iker wanted them to remember, in compar- 
ison with the rest of| the class bv' checking their lis- 
tening score" for his speech ngain.^t the class aver.ige 
score. The students .is spe.ikers can tell how well 
they have managed to communicate the information 
they wa-iteil. 

By ret.iining these sheets throughout the informa- 
tive speech nssignments, the student speaker can tell 
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how well he is achieving his ohjeclivcs with individ- 
ual students, with the class, .md in rehition to the 
speeches delivered by his peers. 

* It is dcsirnhic, should lime allow, to carry this pro- 

cedure one or two steps further for at: least one round 
of speeches. Wh.U hi^s been emphasised is a 'post- 
test immedi.itely following eacli speech. The Kom- 
munication Kwi:: is a check on immediate recall. If 
the teacher wants to illustrate the objectisx- of long 
range recall, he can have all or selected students ad- 
minister their origin.il quizzes a week or two later 
and compare the .scores. With this modification tlie 
listener would also be gaining insight into the process 
of retention of items the speaker imiicated as import- 
ant in the first evaluation. A possible second step 
would be one which would precede the speech. In 
order to test the prior knowledge of the topic on the 
part of the class members (as measured by the. stu- 
dent constructed six item test), selectecl student 
speakers might administer a pre- test the day bef'ore 
they speak. If all of these procedures are followed — 
pre-test, post-test, and a delayed post-test — the stu- 
dent will have a fairly complete picture of the process 
of achieving informational objeclises. He will also 
have some idea of the distinctions between recogni- 
tion, recall, and retention of information. 

This mode of evaluation is not to be used in lieu 
of the oral and written criticism but as an extension 
of it. The more extensions of criticism and evalua- 
tion the instructor can adcl which give the student 
speaker a \'iew of^he speaking situation as contain- 
ing many audience members instead of one (the 
instructor giving the grade) the more "real" the 
speaking situ.ition becomes. As a speaker, the student 
is encouraged by the reality of the audience to eval- 
uate his objectives, his method-design within the 
speech for attaining them, and his evaluation tools 
and techniques. He learns to obtain ami utilize feed- 
back in refining his speeches. As a listener, the stu- 
dent is led to evaluate his responsibilities in the com- 
munication process and to attempt to understand 
methods for improving his abilities to recognize and 
recall useful information. 

III. 

I 

As.sKSSMr.NT or Spekchiis to Phusuade 

Problems in assessing the efTectiveness of student 
sj^eechcs proliferate, an|.l the validity of any mode of 
assessment seems always open to attack. HowcvcTj^I 
apart from the dilTicult matter of how valid (or how 
arbitrary') any instrument is, there exists some prac- 



tical problems with which to contend, such as finding 
instruments that take only limited time from crowded 
class schedules .ind also are not mere "busy work" 
unrelated to learning what should be learned. 

And what, indeed, "should be learned" in a basic 
speech course? 

As part of the "communication revolution" in the 
instruction of speech has come the shift from a 
speaker-ceritercd or speech -centered focus of insfruc- 
tion to an audience-centered approach. Whereas 
"skills" are still a necessary and important part of 
basic speech instruction for many good reasons, the 
emphasis in instruction is shifting away from kfiow- 
njg how to make a "good speech" as defined in its 
own terms to knouifig iL-tt interpersonal communica- 
tion is a complicated affair which requires that a stu- 
dent comrnunicator have a good understanding of 
the elements of the speech situation if he is to be 
maximally e/Tective. 

The instrument detailed here is actually a very 
simple and, admittedly, rough measure. It is a simple 
9-point scale to which students are asked to responcl 
from "totally agree" to "tot.dly disagree" with the 
message of a speaker. However, it does meet some 
necessary criteria. First, it t.ikes only about a minute 
to complete; second, students find it easy to do and 
do not seem to think it noxious nor a waste of time; 
third, and most important, it puts focus on "wh.n 
should be learned" — that the receivers in a speech- 
communication event are complicated, changeable, 
and by their very presence affected by the event. 

At least a week before beginning an assignment 
in persuasive speaking, students are asked to submit 
their proposition stated as cle.irly and unambiguously 
as ^possible. A student submitting a v.ague or ambig- 
uous proposition is asked to rewrite it, and he 
is thereby induced to decide as exactly as possible 
just wh.it belief he wants his audience to share or 
what behavior he wants them to perform. 

These propositions (one from each student) are 
listed on a numbered sheet, and then the students are 
asked to make three judgments about each proposi- 
tion. (I) 7*hey are asked to indicate their personal 
Ycapoyiscs to each. (2) They are asked to predict the 
iii'erage response of the audience of which they are 
a part. (3) They are asked to predict the distribution 
of the audience in terms of one of three kinds of 
profiles: tlat distribution (responses scattered across 
most of the range with little clustering); bi-modal 
distribution (clustering of individuals in two areas 
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of the 9'point scale); nnd central tendency (cluster- 
inu of most respondents around one are.i on the 
scale). Typical profiles .ire exemplified for the stu- 
dents at the blackboard. 

At the top of the ratin^^ sheet would appear the 
code: 

B = Bi-Modal; r = riat CT = Central Tendency 

1 = Totally agree 5 = neither agree nor disagree 

2 = Strongly agree 6 = mildly disagree 

3 = Agree 7 = disagree 

4 = Mildly agree 8 = strongly disagree 

9 = totally disagree 

The rest of the rating sheet as completed would look 
ke this: 

Predicted Predicted 
Proposition My Kesponse Class Response Distribntion 

1 7 4 CT 

?. 2 5 . P 

etc. 

Thus, the first u^c of this instrument is really an 
exercise in audience analysis for the scudents. Typ- 
ically the whole exercise takes about twenty minutes 
to do (respnntling to about twenty propositions) after 
a fe\v minutes of explanation. After the exercise is 
completed, one or two students can compute the av- 
er a^je class response and draw the appropriate profile 
in about an hour: and at the next class n^eeting the 
instructor can have the students compare their predic- 
tions with the .actual responses of the group. 

At this point, the student has some notion of where 
his audience stands on all the propositions, and after 
writing his own audience analysis from this infor- 
mation, each student is asked to predict the shift he 
expects his audience to make after he presents his 
. speecli. Pie is asked to support his predictions with 
some "educated guesses" about the variables in his 
audience which might help or hinder his attempt to 
change their beliefs or behaviors. 

Immediately t'ol lowing each presentation, and be- 
fore comments are made by instructor or students, all 
members of the audience are asked to indicate their 
response to the proposition on a small slip of paper 



and also to \\'rite a sentence or two indicating why 
they responded as they did. An example miglit be: 

"A Civilian Review Board should be estab- 
g . r- lished in Monolulu to judge complaints 
— aoainst the police." 

)) ' 

Reasons: ' 

"In sufficient ev'dence" or "speaker himself 
didn't seem convinced" or "My father is a 
policeman and s;'ys review bo.irds are 
worthless." 

The slips are given to each speaker, who then 
C outside of class) computes the average response and 
draws a profile of' the audience. Then he .ittcmpts 
to account for the changes resulting from his 
presentation. 

Finally, one or two weeks after the presentations, 
a few minutes are taken from the beginning of 
a class to have the students respond to the proposi- 
tions covered d;uing those presentations. Tliese slips 
are given to each student and he is asked to compute 
the average response to his proposition and to draw 
a final profile. The purpose of asking for the delayed 
response is to sensitize the students to "sleeper 
effects" and extinction efTects that take place over 
time. For example, cluring a reported outbreak of 
rabies in Hawaii one student speaker received strong 
positive response to a speech w-'di the proposition 
t-h.Lt "All dogs and cats in Hawaii should be required 
to have rabies shots." A week later, after the rabies 
sGxire had been thoroughly discounted in the press, 
the same proposititm received neutral and even nega- 
tive responses. The reasons for the change were ob- 
vious enough in this case. But through this technique 
of asking for a delnyed response students come to 
learn that persuasion cannot be regarded as a "one- 
shot" etTort that yields lastitig effects. 

Other modes of evaluation, such as oral critiques 
of speeches, may continue as usual. The initial class 
exercise and the subsec^uent comparison of actual r,e- 
sponses with predicted responses do take some class 
time, but students tend to find it exciting and an in- 
teresting way to approach audience analysit as com- 
munication strategists, and as performing speakers. 

Fach of these three approaches to the understand- 
ing of Speech-communication behavior have emerged 
through classroom experiences that seemed to demand 
the inclusion of student oriented evaluation and crit- 
icism. The behavioral bases of these techniques have 
been .subjected to practical tests and have proven to 
be useful, interesting and realistic approaches for our 
classrooms. Moclification and extended application 
should prove worthwhile and, perhaps, such effort 
will lead to new and exciting innovations in other 
speech programs. 
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